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1. Introduction 

Let (yt)tgK be the output process of an unknown deterministic linear time- 
invariant sequence (ut)tg^, which is driven by an unobservable input sequence 
{Xt)t£TL added with a noise sequence (cto W^(0)t6^i where cto is an unknown 
level noise. In other words, {Yt)te7L is issued of the noisy blind deconvolution 
model defined by 

Yt = {u^X)t + (ToWt = Y.UkXt-k+<yoWt,yte7L (1.1) 

where (Xf)fg^ is assumed to be a complex discrete finite valued input process 
and the real- valued filter (wt)tgz; € ^i(^) is supposed to invertible. 

Since the sequence (Mt)tgz; is invertible, it exists 6 ~ {OtjteTL the inverse 
filter of (ut)tg^, such that J2te7z''^t^k~t = I{fc=o}- Note that if {ut)t£7z. has a 
finite length, the system is a noisy moving average and if {Ot)te^ has a finite 
length, the system is a noisy autoregressive. From n observations (i^t){i<t<„}, 
the objective is to restitute the distribution of the input process (X()(g^ which 
requires the estimation of the level of noise cto and the filter {ut)t£'z- In dig- 
ital signal framework, that is, when {Xt)t£2z. is a discrete valued input, the 
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Bayesian theory combined with the MCMC methods is often used to obtain the 
a posteriori distribution of the signal process {Xt)t£iL (Liu & Chen [1995]; Li 
& Shedden [2001]). Here, we adopt the approach which consists in estimating 
the inverse filter (G)t^TL instead of estimating the filter itself (u)ig^. The prob- 
lem of estimating {6t)t£2L as well as the distribution of the input process from 
the observed output data (yt)t=i,- - ,n is known as an identification problem. 
This identification problem when the distribution of the input signal is discrete 
with a finite number of possible values, is discussed in a number of papers: Li 
[1992, 1993, 1995, 1999, 2003], Li & Mbarek [1997], Gamboa & Gassiat [1996] 
or Gassiat & Gautherat [1998, 1999] and Gautherat [1997, 2002]. In the real 
and complex cases without noise, Li [1995] proposed an estimation method for 
the inverse filter when the support points of the input signal are supposed to 
be known. Gamboa & Gassiat [1996] in the non-noisy real case under a gen- 
eral setting (unknown distribution of the input signal) proved the consistency 
of the inverse filter estimate and that of the cardinality of the support's points. 
Gassiat & Gautherat [1998] extended in some sense the previous paper in con- 
sidering data with an additive noise and proposed consistent estimates for the 
support's points and also for the level noise. Gassiat & Gautherat [1999] studied 
the rate of convergence of the signal estimate and the inverse filter estimate in 
the parametric framework whereas Gautherat [2002] also established asymptotic 
distribution for the points and their corresponding mass of the signal distribu- 
tion. To construct the cost function, some of these authors explicitly used the 
alphabet of the signal values (Li [2003, 1992, 1993, 1995, 1999]; Li & Mbarek 
[1997]), whereas Gamboa & Gassiat [1996], Gassiat & Gautherat [1998, 1999] 
and Gautherat [1997, 2002] used only the cardinality of the alphabet (non com- 
municative situation). 

Chen & Li [1995], Gamboa & Gassiat [1996, 1997a, 1997b], and Gunther & 
Swindlehurst [2000] showed that incorporating the finite alphabet information 
into blind deconvolution procedures can greatly improve the accuracy of the 
filter estimation and that of the signal distribution in the non-noisy situation. 
Due to the judicious utilization of the finite alphabet information, these methods 
enjoyed a number of desirable properties in the non-noisy situation such that, the 
ability to handle (with super statistical efficiently) a large class of filters {ut)t£'z, 
the ability to handle non-stationary (see the papers of Li) or non i.i.d. signals 
(Gamboa & Gassiat [1996]) without modeling or estimating their statistical 
characteristics. 

In the model (1.1), the blind deconvolution of the data is much more com- 
phcated due to the presence of the noise. Gassiat and Gautherat [1998, 1999] 
and Gautherat [1997, 2002] proposed a consistent estimation procedure which is 
based on the minimization of a penalized empirical constrast function. In prac- 
tice, this method needs to adjust the penalty term and requires a starting point 
which is near enough to the true value in order to avoid a local minimizer. 

Among these works, the main contribution of our paper is to provide in the 
complex case, a new estimation procedure of the level of noise and the inverse 
filter, which is a consequence of the sharp study of the Hankel matrix when the 
noise is supposed to be Gaussian. Our estimation procedure is built on an ex- 
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plicit empirical criteria (it is not the same in the papers of Gassiat & Gautherat 
[1998, 1999] and Gautherat [1997, 2002]), and it is based on the roots of an em- 
pirical function. Our estimation method is competitive from a theoretical point 
of view (consistency and asymptotic distribution of all estimates) and from a 
practical side (our numerical results are quite good). 

The paper is organized as follows. The assumptions on the model defined by 
(1.1) are given in Section 2. In the same section, the level of noise, the inverse 
filter and the law of the input signal are characterized. These characterizations 
are used to define in Section 3 our estimation procedures. The strong consis- 
tency and the asymptotic distribution of all the estimates are stated in Section 
4. The proofs are postponed in Section 7. Section 5 deals with a simulation 
study in which the computational performance of our estimation procedures is 
empirically demonstrated. Some concluding remarks including a comparison of 
our numerical results with those given in Gassiat & Gautherat [1998], are made 
in Section 6. 

2. Assumptions and Characterization 
2.1. Assumptions 

(Ml) {Xk)k^7L is a sequence of discrete complex random variables with a com- 
mon discrete support a = (ai,...,ap) G CT; a is unknown, ^ aj for 
i 7^ ). The integer p > 2 is known. The components (aj")i<j"<p of a are 
given by the lexicographical order. 
(Mlb) {Xk)k£7L is identically distributed with support points a E 0' and 11 = 
(7i'j){j=i,...,p} is such that TP{Xk = aj) ~ -Kj Vj e {1, ■ ■ ■ ,p} and for any 
k & 7L. The integer p > 2 is known. The components (aj)i<j<p of a are 
given by the lexicographical order. 

(M2) (Xfc)feg^ is a stationary ergodic process. 

(M3) V7lGIN^V(jl,...,j„)e{l,...,p}", P(Xi=a,,,...,X„ = ajJ > 0. 

(M4) yk eTL,Wu = iWi, where = {W^)u^tl and = {WDk^^L 

are independent. The random variables [W^)k£'s, and {WDkezi are real 
centered i.i.d. Gaussian with a variance equal to (1/2) and they are both 
independent of (Xk). 

(M5) U{x) = J2k ■"fcC**'^ is continuous and does not vanish on [0, 27r]. 

Note that Assumption (M5) guarantees that (ut)tgK is invertible and that 
both (tit)tgK and its inverse are in li{7L). Since (ut)tg^ is invertible, the initial 
observed process {Yt)t£7L can be transformed by applying any filter s to Yt- The 
resulting process Zt{s) is then defined by 

vt e 2;,Zt(s) (s*y)t. (2.1) 

(M6) The set of the filters is defined by 9 = {s(0 e li{7L),i € /C}, where 
the function s is known, s G C"'^ is injective. The true inverse filter 9 is 
in Q. The set tC C H'', d G IN* is compact such that if G /C satisfy 
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5fe(0 — Vfc e S ^ r = 1, 1 = 0, and ^ = ^. The parameter ^ is 

unknown. 

Remark 2.1. 

(i) Assumption (M6) describes the set O at which the filters we consider, belong. 
The set is parametric via the unknown parameter vector so that estimating 
the inverse filter 6 is reduced to estimate ^o- 

(ii) Since the true inverse filter 9 belongs to Q and since the function s is 
injective, it implies that it exists the interior of K. such that s(^o) = 9. 
Moreover, the last part of Assumption (M6) guarantees the identifiability of the 
model; in particular, it allows to avoid problems of scale and delay. 

(Hi) In the non noisy case, note that Zt{9) = Xt, \lt ^TL where Zt{-) is defined 
by equation (2.1). Our estimation procedures will be based on the process Zt{s), 

see. 

2. 2. Characterizations 

In the non-noisy framework (do = 0), Gamboa & Gassiat [1996] stated that, 
midcr (Ml), (M3), (M4) and (M5), Zt{s) takes at most p distinct values if 
and only if s = up to scale and delay. The definition of 9 as a subset of l\[7L) 
avoids identifiability problems which could be generated by possible changes 
in scale or delay. But since the characterizations of ctq and 9 are valid for any 
inverse filter in li{7L), from now and only for this paragraph, let us consider any 
filter s in h{7L). 

The random variable Zt{s) for s 9 having at least p points of support, 
the characterization of ctq and Q is made via a contrast function which is able 
to distinguish discrete random variables whose support is of cardinality p from 
others whose support is of cardinality greater than p. 

Let d{s) be the conjugate moment column vector of dimension (p + 1)^ defined 
by 

= IE ((Zo(s))'^(Zo(s))j) ,y{j.k) G {0, . . . ,ri2,Vs e /i(S).(2.2) 

Note that if one rewrites d{s) in a {{p + 1) x (p + l))-matrix D{s) where j and 
k correspond respectively to the columns and the rows then D(s) is a Hankel 
matrix. For all s S /i(^) and cr > 0, it is always possible to derive the conjugate 
pseudo-moment d{a, s) from d{s) in inverting the following system: 

d{s)=A{a\\.s\\2)d{a,s), (2.3) 

where ||s||2 denotes the /2-norm of s. The matrix ^(cr||s||2), which depends 
on (7||s||2, is an invertible (p + 1)^ x (p + l)^-matrix such that for any pair 
(j, /c) e {0, . . . ,p} X {0, . . . ,p} and V < m < j, < / < fc, V/3 € H, 
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where 7™,; IE((Wo)'(Wo)™). Note that under (M4) one gets 7™,; = I,„=/m!. 
Since ^rn,i 7^ / = to, denote 7™,; = 7m- The inversion of the sys- 

tem (2.3) is exphcit and A^^(ct||s|12) is defined by the following: V (j, fc) S 
{0,...,p}2 such that < m < (j - fc V 0), and V/3 g IR+, 

^](p+l)+k+l,m(p+l)+k-j+m+l^P) ^ '"C'it C"^lj-m0^''-' (2.4) 

Remark 2.2. Denoie 62/ (i?(s))t = {s-ku-kX)t and {V{s))t = {s-kW)t, 'iteTL 
and Vs e li(7L). Then, V cr < (Tq a'^'^ f^we to the infinite divisibility of the 
Gaussian distribution, V(j, k) £ {0, . . . c'j(p+i)+(fe+i) (c, s) is equal to 



{R{s)), + y^a2-cT2(V^(s))o)) ({R{s)), + v/^^~^(V^(s))o 



On the other hand, if a > CTo , d,{(7, s) has no explicit form, one does not know if 
it corresponds to a random variable moment. This explains why d(a, s) is called 
the pseudo-moment vector. 

Next, transform the pseudo-moment vector d{a,s) in a {{p + 1) x [p + 1))- 
matrix D{a, s) where j and k correspond respectively to the columns and the 

rows i.e. D{a,s) = ( (cr, s) ) . Then, let J be the real 

function defined by: 

Vcr>0, Vse/i(S), J{a,s) = det(L>(cr,.s)). (2.5) 

The characterizations of 9, ao, a and 11 in the model described by relation (1.1) 
or equivalently by relation (2.1), are made through the function J defined by 
(2.5). They are established in Gassiat & Gautherat [1999] for 9 and ao, and in 
Gautherat [1997, 2002] for a and 11 imder a more general setting: 

• (i) Under assumptions (Ml), (M3), (M4) and (M5), the true level noise 
CTo and the true inverse filter 9 = 5(^0) satisfy 

Vct < CTo, J(ct, s(0) > 0, G /C (2.6) 

J(cto,s(^)) = iff s(^) = 6* up to scale an delay. (2.7) 

• (ii) Under (Ml), the distribution points a = (ai){i=i,...,p} ^he roots of 

p 

the polynomial function p„* in C[X] defined by py*{x) = 'y^y*x-' , where 

3=0 

V* denotes the eigenvector associated with the smallest eigenvalue of the 
matrix D{a-o, 9). 

• (iii) Under (Mlb), the distribution 11 = (tti, . . . , TTp) is uniquely deter- 
mined as the solution of the following hnear system in (gi, . . . , qp) G [0, 1]*': 

nx^) = Y.Llq^4 vfc = o,...,p-i. 

Note that (i) implies that cto = min{CT > 0; 3s G li{7L) : J(ct, s) = 0}. 
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3. Estimation procedures 

To construct our estimates, we consider again the filters of the form s(^), where 
^ € /C is unknown and s is a known function. For any ^ G /C, let us consider the 
truncated sequence s(^) of s(^) € 9 C Ii{71j) as Sfc(^) = Sk{£,)^\k\<k(n) Vfc S 7L, 
where fc(n) is a sequence of nonnegative integers increasing with n. Denote also 
||s(')lln,2 — l|s(-)||2- Define the truncated version of relation (2.1) that is, 

fc(n) 

V^e/C, V< = l + fc(n),...,7i-fc(7i), Ztim)^ ^k{i)Yt-k- 

k— — k{n) 

Denote dn{£,) the empirical conjugate moment vector of dimension [p + 1)^, 
whose general term (ij(p+i)+A;-f i,n(^) is defined as the empirical version of (2.2), 

n — k{n) 
^ ' t=l+k{n) 

Then, similarly to (2.3), define dn{£,) as the empirical conjugate pseudo-moment 
vector whose general term dj(^p^ij^k+i.n{0 is the solution of the following tri- 
angular system: 

Vee/C,Va>0, J„(a,e) = A-i(a||5(C)||2)d„(0, (3.1) 

where A~^(/3) is the matrix defined by (2.4). Finally, let J„ be the empirical 
version of J defined by (2.5): 

e /C,Va > 0, Jn{a,0 = det(^„(a, s(0)), 

where D„ is the 1) x (p+ l))-matrix corresponding to the rewriting of the 
empirical pseudo- moment vector d„((T, ^) in a matrix form. Finally, let us define 
all the estimates: 

• (f^Oi^o ) is the solution of the following system 

\ ctq = min {(T e IR+; 3^ e /C : J„((t, C) = 0} . 

• 6' is defined as 9 ~ s(Co)- 

• The support points (ai, . . . ,ap) in CP are the roots rearranged by the lex- 

p 

icographic order of the polynomial function p:^i,{x) = 'Yj^^'' ^I"''^]' 

j=o 

where v* = {v^, . . . ,v^) denotes the eigenvector associated with the small- 
est eigenvalue of the matrix Dnido, s(^o))- 

• The probability vector (tti, . . . , Tip) is uniquely determined as the solution 
of the following linear system in {qi, . . . , qp) G [0, 1]^: dk+i,n{o'o, s(^o)) = 
ELi*^i' Vj = 0, . . . 1. 
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Existence of (ctq , Co ) for any n e IN* . 

For any n G IN*, fix ^ G /C and observe dn{C)- Then, c?„(ct, C) is obtained via equa- 
tion (3.1) and depends only on the unknown parameter a throughout c||s(C)ll2 
since s{£) is supposed to be fixed. For any v G C^^^, consider the hermitian 
form 

p p 

Qv{cr) = '^^dj{p+i)+(k+i),n{cr,OvkVj. 

Note that Qy is a polynomial function in a with real coefficients. For any 
V e (D^+\ note that Qv{Q) = Det{Dn{C)) > 0, where £'„(0 is a Hankel matrix 
of dimension ((p+1) x (p+1)) which corresponds to the rewriting of the vector 
dn{£,)- Note also that the highest degree of Q.^ is equal to 2p. 
Then, if p is an odd number, the cocfhcicnt of the highest term is equal to 
(— 1)^ p!(P(C)IU.2)^^^P^P which is negative. It entails that it exists a real posi- 
tive (T„ such that Qvid'n) = that is, the hermitian form is degenerate and then 

Jni^n,0 = 0. 

On the other hand, if p is an even number, choose any v = {vo,vi, . . . , Vp)' G 
such that Vp = 0, where the w' denotes the transposed vector of v. Then, 
the term of the highest degree is negative and is of order a'^'^P~^\ As previously, 
it allows to conclude to the existence of a real positive (t„ which is a zero for 

U;0- 



4. Main results 



Up to now. for any function F with one or more arguments, set D^F{y) be the 
value at y of the r-th differential of F and set d^^^^.]. F{y) be the value at y 

I 

of the Cy^Tj^ )-tli partial derivative of F^ where r^^ is the order of the derivative 

with respect to its ifc-th coordinate. Denote also (i(C) the {p + l)^-vcctor with 
components dji^p+i)+(^k+i),n{C) ■= dj{p+i)+(k+i),nis{0) defined by relation (2.2). 
Some extra other assumptions are needed to establish the consistency and the 
asymptotic distribution of all estimates. 

(M7) k(n)^o(y/n), V |6'fc| o(^) as n +oo 

— ' \/n 

\k\>k{n) ^ 

(M8) ^{dn{^o)~d{^o),D'dn{^o)-D^d{^o)) ~ . AA(0, F). Denote Fi the 

asymptotic variance of y/n {dn{^o) — rf(Co))- 
(P) The application ^ > s{^) is twice continuously differentiable. For any 
i = l,...,d, {dlsk{^o))k<E7Z. and {dfsk{^o))ke2L are in li{7L). Moreover, 
{{dlski^o))ke2L, ■ ■ ■ , id^Sk{^o))ke7Z.) and (sfe(Co))fcez; are linearly indepen- 
dent. 

Theorem 4.1. Suppose that assumptions (M1)-(M7) hold, then as n goes to 
infinity, ao converges a.s. to (Tq o.'i^d S,o ~ Co 
denotes the Euclidean norm in TR'^ . 



converges a.s. to 0, where \\ ■ \\ 
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Corollary 4.1. Suppose that assumptions (Mlb), (M2)-(M7) hold, then as n 



goes to infinity, both \\a — a\\ and 
the Euclidean norm in JRF . 



n-n 



converge a.s. to 0, where || -H denotes 



Before giving the asymptotic distribution of our estimates, recall that the vector 
V* £ C^"*"^ is the eigenvector associated with the smallest eigenvalue of D{ao, 0), 
and denote v{b) any vector in C^"*"^ n {|| • II2 = 1} associated with 6 G such 
that the v{b)j's are the complex coefficients of the polynomial function in (D[X] 
having the components of b as roots. In particular, note that v{a) = v*. 

Theorem 4.2. Under assumptions (M1)-(M8) and (P), 

^ Af(Od+i,ND'h{d{ao,^o))M{D'h{d{<Jo,^o))yN') , 



(To — CTO 



where Od+i is the (d + l)-dimensional zero vector and 

M = A-\a„\\eh)T,{A'\<Jo\\eh)y, 

N : 



1 / dp {ao, ^0)'^ dip {<Jo,^o) 



1 

^(rf(CTo,$o)) = det ( (d,(p+i)+,;+i(cro,?o) ) 



p} 



Corollary 4.2. Under (Mlb), (M2)-(M8) and (P) and using the previous 
notations, one gets 

y^(a~a) > Af (Op,-^C-^ B RMB' R'C-^] , 

Vn(n - n) — ^ TV (Op, G RM R' g' 



n 00 
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where, 

p 

C = diag(ifi,...,ifp),withi^j =]E ( \{ |Xo-a,n, 

B is a p X (p + l)^-niatrix which is defined by its columns as follows 

yi e with e {0,...,p}2, 

where Id^ is the identity matrix of size d, 
G = L-\Proj+F^^B), 

L = fa',)„,.^ , , , , where i denotes the rows and j the columns, 

F = {^'p (-^*«n.=2,...,p,,=i....,p 

where i denotes the rows, j denotes the columns, 
Proj is the projection of C*-^^^' on <iT such that 

Vw e Proj{w) =v, V ^ {wi,.. . , Wp)'. 

Remark 4.1. The proof of Theorem 4-2 is obtained using similar arguments 
as in Gassiat & Gautherat's proof of Theorem 4-2 [1999]. The gain, we obtain, 
with our estimation procedures (without penalty term) is the asymptotic marginal 
distribution of both (^o — ^o) cind (ctq — fo)- This is an essential point to obtain 
the asymptotic distribution of both a and H. 

5. Simulation study 

In this section, the estimates of cto, £,o, {ai)i<i<p and (7ri)i<i<p are provided 
using our theoretical estimation procedures. To give stable results, each estima- 
tion value is an average over N = 100 independent simulations of sequence of n 
observations. These estimation values are denoted by E in the arrays below. The 
stability of each estimation value is measured by " std" , the empirical standard 
deviation calculated over the simulation runs. The simulations which lead to a 
negative value of 11 are eliminated and N^um in the arrays below is the number 
of those eliminated simulations. 

Two models are considered in this simulation study: the mixture model and 
the autoregressive model that is, each simulation sequence {{Yt^i)i<t<n, i<i<n) 
is issued of one of these models which are particular cases of model defined 
by (1.1). In both cases, the filter has a finite length, so we identify the inverse 
filter 9 = s(^o) to ^o- We restrict ourselves to p = 3 and we deal with two 
values of ao: o-q = 0.05 and ctq = 1; a small uo (respectively a large ctq) give 
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small perturbations (resp. large perturbations) to the corresponding non-noisy 
model defined by (1.1) so that it is more complicated to estimate it well in the 
case of a large (Tq- To illustrated the asymptotic efficiency of our method, we 
deal with several n {n = 50, 100, 250, 500, 750, 1000, 1500, 2000) and k{n) 
{k{n) = 1, 2) but only few significant results are presented here. We use the 
function "fsolve" in MATLAB version 7 which allows to find a root of a given 
function. The problem of the use of such a function is its very sensitivity to the 
starting point since it searches a zero near the starting point. To overcome this 
difficulty, we try several starting points in order to select as the initial point 
the one which seems more stable during the simulations. To avoid problems 
relied on both scale and delay of 6*, we fix the scale and delay in considering 
^ = (^fe)|fc|<fc(n) such that |16'||2.n = 1 and {0^k{n)) has the greatest value among 
all the components of 6. 

Mixture model. The observed sequence Yi, . . . , y„ is given by 

Yt=Xt + aQWu Vi e {l,...,7i}, 

so that the filter and its inverse coincide i.e. 9t ~ Ut — 6o{t) Vt e One must 
note that the model is over-parameterized since we choose k{n) = 1 (first array) 
and k{n) = 2 (second array) whereas the true inverse filter is reduced to one 
value 9q = 1 which corresponds to k{n) = 0. The cases n = 50 and n = 2000 
are presented in the arrays below. When o-q = 0.05, the estimation values of 
{0'i)i<i<3 and (7ri)i<i<3 are really good even for a small n (n ^ 50) and k{n) = 2. 
For both ctq = 0.05 and ctq = 1 and both k{n) ~ 1 and k{n) = 2, the estimation 
values of ctq and 6 are strongly different between n = 50 and n = 2000: they 
are much more better for n large. These arrays illustrate that it is more difficult 
to obtain a good estimation when a is large or/and when k{n) = 2 or/and 
when n = 50. It is worthwhile to note that for ctq = 1 the number of non-used 
sequences is NeUm = 30 {n ~ 50, k{n) = 1), N^iim — 53 {n — 2000, k{n) = 1), 
NeKni = 38 (n = 50, k{n) = 2) and N^um = 45 (n = 2000, k{n) = 2), so that it 
would probably mean that we do not find an interesting starting point; moreover 
it entails a strong variability on the values (see the std) . Figure 1 represents the 
n observations Yi, . . . , y„, the support points ai, 02, 03 and their estimates ai, 
0,2 and as which are denoted o^gg^j, i = 1,2,3. When ctq is small (ctq = 0.05), 
the observations are concentrated on the true support points and the estimation 
for k{n) = 1 is visually very good even for a small sample (Figure 1, left side). 
When (To is large (cq = 1)1 the observations are more scattered over the square 
even one can distinguish three attractive areas where the support points lie. For 
this case and k{n) ~ 1, the estimation with 1000 observations is visually much 
more better than the one with 50 observations (Figure 1, right side). The same 
phenomenon is observed in Figure 2 but in addition Figure 2 illustrates the 
improvement of the estimation: when n is increasing, the estimates approach 
the true values and their empirical standard deviations tend to zero (except for 
one case). 

Second order autoregressive model. The observed sequence Yi, . . . ,y„ is 
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given by 

Yt=Yt + naWu Vt€ {l,...,n}, 

where 

2 

k— — oo k—0 

with {60,61,62) ^ = (0.8571,-0.2857,0.4286). One must note that 

when we choose k(n) ~ 2, the model is over-parameterized since the true model 
corresponds to k{n) = 1. In the left hand side of the third table (fc(n) = 1) 
with a small ctq = 0.05, the estimations of all the parameters are quite good 
and they are quite similar for both large n and small n. All other cases i.e 
(To = 1 with = 1 and k{n) = 2, large n {n = 1000 or n = 2000) lead to 
an improvement in the estimation values since some estimations for n = 50 are 
very far from the true values (see both the right hand side of the third table 
and the fourth table). However, in some cases it seems that we do not take an 
interesting starting point since the variability of the results is too large (see 
for example the std for k{n) ~ 1 and (Tq = 1) combined with an important 
number of eliminated simulations (see NeUm for k{n) = 1 and (Tq = 1)- One can 
see in Figure 3 that the observations are more dispersed over the square than 
those of the mixture model (Figure 1). It would mean that an autoregressive 
model is more difficult to estimate than a mixture model. When (Tq is small 
((To = 0.05), Figure 3 and Figure 4 show that the support's points (ai)i<i<3 are 
well estimated for k{n) ~ 1 even for a small n; this is not the case for k{n) = 2 
since the estimates seem visually (see Figure 4) far from the true values even 
for large n {n = 1000). 

Numerical illustration of the existence of the estimate (To- Let us con- 
sider the second order autoregressive model with cto = 1 and let k(n) be equal 
to 2. This corresponds to the most difficult estimation problem as it is illus- 
trated in the above simulations. Figure 5 represents the graph of the function 
a Gn.s{^) (f) = sign{Jn{o; £,)) * log{\Jn{<J, ^)| -|- 1) which has the same roots as 
the function cr —> J„(cr, ^). In the left hand side, we consider the particular case 
of s(^o) = (^0,^1,^2,0,0) which is the true value of the inverse filter, whereas 
in the right hand side, we consider the particular case of s(^) = (1,0,0,0,0) 
which differs from the true value of the inverse filter (this filter corresponds to 
a mixture model). In both cases, one can see that Gn,g{^) admits some zeros. In 
the left hand side, one must note that the convergence is achieved very quickly 
and accurately. 

Importance of the choice of the starting point in the algorithm. One can 

see in Figure 5 that the first zero of the function J„ is neither over ctq nor under 
(To. Actually, the Matlab toolbox algorithm searches the zero of the function 
which is the nearest to the starting point. This starting point being a (2fc(ri,)-|-2)- 
dimensional vector, the algorithm searches a zero in (2fc(n) -I- 2) directions. So 
an iterative stochastic algorithm, which is able to find a multidimensional zero, 
would be an useful tool since the gradient of J„ could be formally computed. 

Imsart-ps ver. 2007/09/18 file: ejs_2007_138.tex date: February 2, 2008 



E. Gautherat et al. /Parametric estimation in noisy blind discrete deconvolution 12 



CTQ = 0.05 


,^ 


E ±sid 


0-0 = 1 

k{n) = 1 


r^ 


E ±std 


"0 


50 


0.1397 ±0.2125 
0554 ibO 0114 


'^0 


50 


1.0139 ±0.1672 
1 1403 ±0 1936 


"a 


50 


0.9627 ±0.0962 
n oooo -l-n nnno 

U . y ZC U . U U U ^ 


^'o 


50 


0.8821 ±0.1100 


fi 


50 
2000 


0.0732 ±0.1866 
0.0000 ±0.0128 


^1 


50 
2000 


0.1192 ±0.3169 
0.0931 ±0.2834 


82 


50 
2000 


0.0510 ±0.1479 
0.0006 ±0.0063 


^2 


50 
2000 


0.1087 ±0.2935 
0.0489 ±0.2566 


^^3 


50 
2000 


-2.1146 - 1.0012 i ±0.2996 
-2.0004 - 0.9996 i ±0.0130 


•^3 


50 
2000 


-2.5278- 0.8964 i ±1.3044 
-2.1064 - 0.9275 i ±0.2689 


a2 


50 
2000 


-1.0265 +2.9403 i ±0.4038 
-1.0002 + 3.0000 i ±0.0129 


0^2 


50 
2000 


-1.1398 + 2.2255 i ±1.6165 
-0.7987 + 2.6327 i ±0.8427 


ai 


50 
2000 


3.6058 + 1.0336 i ±1.1026 
3.9984 + 1.0000 i ±0.0152 


"1 


50 
2000 


2.9865+ 1.0596 i ±1.6399 
3.7181 +1.1201 i ±0.5812 


ni 


50 
2000 


0.5906 ±0.0690 
0.6000 ±0.0104 


ni 


50 
2000 


0.4853 ±0.1214 
0.5681 ±0.0865 




50 
2000 


0.2468 ±0.0671 
0.2509 ±0.0091 


n2 


50 
2000 


0.3374 ±0.1397 
0.2923 ±0.0939 


"3 


50 
2000 


0.1625 ±0.0597 
0.1492 ±0.0078 


n3 


50 
2000 


0.1773 ±0.0686 
0.1396 ±0.0233 




50 
2000 


4 





50 
2000 


30 
53 



Table 1 

(fo,fl,S2, 01,12,03,771,712,773) = (l,0,0,4 + i,-l + 3j, -2-1,0.6, 0.25, 0.15). The Starling 
point of left array is ((Tini, ''ini.o, ^ini.l, ^^1711,2) = (0.001, 1.2, —0.5,0.02) and the star-ting 
point of right array is {aini,6ini,o,dini,i,dini,2) = (0.1,1.2,-0.4,0.2). 



CTQ = 0.05 
k{,n) = 2 




E ±sfd 


CTQ = 1 
k{n) = 2 




E ±std 


f^O 


50 
2000 


0.3913 ±0.3550 
0.0542 ±0.0078 




50 
2000 


1.0467 ±0.1906 
1.1649 ±0.2807 


^0 


50 
2000 


0.8362 ±0.1686 
0.9999 ±0.0001 


% 


50 
2000 


0.7038 ±0.1283 
0.9195 ±0.1405 


f>l 


50 
2000 


0.0674 ±0.2417 
-0.0003 ±0.0053 


Ol 


50 
2000 


0.1393 ±0.3311 
-0.0087 ±0.1796 


02 


50 
2000 


0.0840 ±0.2086 
0.0001 ±0.0080 


02 


50 
2000 


0.1962 ±0.2900 
0.0232 ±0.1728 


^3 


50 
2000 


0.1308 ±0.2520 
0.0000 ±0.0047 


^3 


50 
2000 


0.1724 ±0.2707 
0.0077 ±0.2007 


64 


50 
2000 


0.1026 ±0.2664 
-0.0000 ±0.0054 


94 


50 
2000 


0.0998 ±0.3609 
0.0077 ±0.1858 


^^3 


50 
2000 


-2.4801 -0.9127 i ±0.9610 
-1.9996 - 1.0002 i ±0.0112 




50 
2000 


-2.8623- 0.8196 i ±1.5551 
-2.0936 -0.9478 i ±0.3934 


a2 


50 
2000 


-1.2051 + 2.5834 i ±1.3587 
-0.9997 + 3.0000 i ±0.0115 




50 
2000 


-1.0714 + 1.4250 i ±2.2831 
-0.7886 + 2.5256 i ±0.9606 


ai 


50 
2000 


3.1553 + 1.2781 i ±1.5967 
3.9999 + 1.0001 i ±0.0109 




50 
2000 


2.4786 + 1.1597 i ±2.3074 
3.7623 + 1.0584 i ±0.8220 


ni 


50 
2000 


0.5211 ±0.1270 
0.5997 ±0.0115 


ni 


50 
2000 


0.4341 ±0.1474 
0.5436 ±0.1302 


n2 


50 
2000 


0.3011 ±0.1314 
0.2510 ±0.0091 


n2 


50 
2000 


0.3476 ±0.1407 
0.3161 ±0.1294 


n3 


50 
2000 


0.1778 ±0.0812 
0.1493 ±0.0084 


n3 


50 
2000 


0.2183 ±0.1353 
0.1403 ±0.0317 




50 
2000 


20 





50 
2000 


38 
45 



Table 2 

(1, 0, 0, 4 + i, -1 + Si, -2 - i, 0.6, 0.25, 0.15). Starting point of left array 
(f^ini, iSini,i)o<i<i)^O.Ol, 0.3, —0.1, 0.2, —0.1, 0.1) and starting point right array 
" (^ini, (6',ni,i)o<i<4)=(0.1, 0.3, -0.1, 0.2, -0.1, 0.1), 
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CTQ = 0.05 

k{n) = 1 




E ±std 


"0 = 1 
fc(n) = 1 




E ±std 


"0 


50 
1000 


0.0565 ±0.0133 
0.0591 ±0.0161 


"0 


100 
1000 


1.1764 ±0.2959 
1.2805 ±0.3006 


oo 


50 
1000 


0.8627 ±0.0045 
0.8636 ±0.0068 


Do 


100 
1000 


0.8263 ±0.0572 
0.7814 ±0.0541 


"l 


50 
1000 


-0.2786 ±0.0076 
-0.2776 ±0.0098 


Ol 


100 
1000 


0.0325 ±0.3910 
-0.1880 ±0.2438 


^2 


50 
1000 


0.4220 ±0.0051 
0.4207 ±0.0078 


^2 


100 
1000 


0. 1640 ±0.3700 
0.4816 ±0.2503 


^^3 


50 
1000 


-2.0130 - 1.0067i ±0.0182 
-2.0174 - l.OOQSi ±0.0240 


•^3 


100 
1000 


-3.4094 - O.S5S3i ±3.4494 
-2.3470 - 1.2209i ±1.1879 


a2 


50 
1000 


-1.0090 + 3.0197i ±0.0276 
-1.0088 + 3.0246i ±0.0319 


a2 


100 
1000 


-1.9715 + 3.5025i ±3.6024 
-1.0180 + 2.7762i ±2.0138 


ai 


50 
1000 


4.0261 + l.OOSli ±0.0299 
4.0338 + 1.0082i ±0.0395 


ai 


100 
1000 


5.3438 + l.lSSTi ±5.2553 
3.4259 + 1.0842 i ±1.8686 


ni 


50 
1000 


0.6087 ±0.0539 
0.5998 ±0.0147 


ni 


100 
1000 


0.5078 ±0.1227 
0.5235 ±0.1352 


n2 


50 
1000 


0.2517 ±0.0489 
0.2504 ±0.0133 


n2 


100 
1000 


0.3075 ±0.0898 
0.2877 ±0.0833 


n3 


50 
1000 


0.1396 ±0.0326 
0.1498 ±0.0105 


na 


100 
1000 


0.1847 ±0.0635 
0.1887 ±0.1088 




50 
1000 








100 
1000 


58 
56 



Table 3 

(6»o, ^1, 6»2, ai, a2, as, Hi, n2, Hs) = (6/7, -2/7, 3/7, 4 + i, -1 + Si, -2 - i, 0.6, 0.25, 0.15). The 
starting point of left array is {c!ini,dinifl,Qini,i,Qini,2) = (0.001,0.5,-0.5,0.5) whereas the 
right array's is {o-i„i,di„ifi,9ini,i,Si„i,2) = (0.5,0.6,-0.2,0.2). 
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k(n) = 2 
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E ±std 
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0.1642 ±0.3229 
0.0580 ±0.0080 


f^O 


100 
2000 


1.1082 ±0.1266 
1.2655 ±0.0751 




50 
1000 


0.8090 ±0.0770 
0.8632 ±0.0010 


fo 


100 
2000 


0.8314 ±0.0613 
0.8390 ±0.0475 


»1 


50 
1000 


-0.2855 ±0.0695 
-0.2787 ±0.0019 


^1 


100 
2000 


-0.3027 ±0.1049 
-0.2961 ±0.1154 




50 
1000 


0.3815 ±0.0754 
0.4209 ±0.0011 


^2 


100 
2000 


0.2419 ±0.1115 
0.2415 ±0.1018 


O3 


50 
1000 


0.1552 ±0.1866 
0.0002 ±0.0018 


^^3 


100 
2000 


0.1408 ±0.1808 
0.1062 ±0.1910 


64 


50 
1000 


-0.1278 ±0.1658 
-0.0014 ±0.0014 


f 4 


100 
2000 


-0.2608 ±0.1080 
-0.2639 ±0.0874 


■^3 


50 
1000 


-2.5866 - 0.6725i ±2.5778 
-2.0125 - 1.0080 i ±0.0050 


-^3 


100 
2000 


-2.3404 - 1.1354i ±1.3817 
-1.9004 - 1.1264 i ±0.2632 


a2 


50 
1000 


-1.4271 + 2.8472 i ±2.0162 
-1.0046 + 3.0204 i ±0.0068 


a-2 


100 
2000 


-1.0821 + 2.7644i ±1.6653 
-0.7037 + 2.5984 i ±0.3441 


ai 


50 
1000 


4.2549 + 1.420S i ±1.2687 
4.0316 + 1.0070 i ±0.0085 


ai 


100 
2000 


4.3995 + 1.0729 i ±0.9172 
4.1748 + 0.9867 i ±0.3380 


ni 


50 
1000 


0.5268 ±0.1337 
0.6000 ±0.0145 


ni 


100 
2000 


0.5133 ±0.1108 
0.5678 ±0.0451 


n2 


50 
1000 


0.2983 ±0.1169 
0.2508 ±0.0117 


n2 


100 
2000 


0.3115 ±0.0991 
0.2799 ±0.0363 


ns 


50 
1000 


0.1749 ±0.0664 
0.1492 ±0.0103 


n3 


100 
2000 


0.1752 ±0.0544 
0.1524 ±0.0142 




50 
1000 


3 





100 
2000 


11 
14 



Table 4 

(6»o,6»i, 612,01,02,03, 771,772,773) = (6/7, -2/7,3/7,4 + 1,-1 + 3j,-2- 4,0.6,0.25,0.15), The 
starting point of left array is {a-i„i, {dini,i)o<i<4,) = (0.005,0.2,0.3,0.2,0.2,0.2) and the 
starting point of right array is (cri„i, (0i„i i)o<j<4) = (0.7,0.2,-0.3,0.2,0.002,0.001). 
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Fig 1. Mixture Model, k{n) = 1. 

Hn=50 ^^^Hn^lOO -jirnsSOO "j^^ n=2000 
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Fig 2, Evolution of a\,a2 and with n. On the first line k{n) = 1, on the second line 
k{n) = 2. For the first row ao =0.05 and for the second row (Tq = 1. 
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Fig 3. Second order autoregresaive, k{n) = 1. 
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Fig 4, Evolution of ai,a2 and with n. On the first line k{n) = 1, on the second line 
k{n) = 2. For the first row ao = 0.05 and for the second row ao = 1- 
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Fig 5. Graph o/G„ ^(j) for k{n) = 2. Second order autoregressive, fro = 1. 

6. Discussion 

• Interest of our estimation procedure. Our procedure estimation does 
not require a priori more specifications of the model than equation (1.1) then it 
takes the advantage to adapt to any situations. 

• Choice of the Hankel matrix. It would be possible to deal with the Toeplitz 
matrix instead of the Hankel matrix of the {Zt) since the characterizations of 9 
and (To given by relations (2.7) and (2.6) also hold for the Toeplitz matrix. More 
generally for the same reason, it would be possible to consider any (p+l)^-vector 
built on the moment of type (]E((0i(Zo(s(^)))'^(/)i(Zo(s(^)))^])fe.jg|i^..._p} where 

is any complex injective function defined on C The main difference would 
lie in the non-trivial determination of A^^, the inverse matrix of A defined in 
relation (2.3). It also could be extend to some entropy distance which allows to 
distinguish variables which have less than p point of support than the others 
(Gamboa & Gassiat [1996]). 

• Gaussian noise. The assumption of a Gaussian noise is not necessary; actu- 
ally only an indivisible law is required for the noise. As previously, it is probably 
more complicated to exhibit the matrix A^^ which contains among others the 
calculations of the jj,k- 

• Method of moments. Traditionally the method of the moments is not very 
well appreciated in estimation problems since a little error on the observations 
entails a big error in the final estimation. In our case, since ctq is not a priori 
estimated, our method takes intrinsically into account such a type of error and 
does not possess the disadvantage of the method of moments. Nevertheless, the 
restitution of the distribution of {Xt)t£^ is based on this method and it would 
be probably more efficient to apply the MCMC methods (see for example Sylvia 
[2001]) since the application of the inverse filter provides a finite mixture with 
a known covariance structure. 

• Computational comparison. In order to compare empirically our method 
with already existing numerical results (Gassiat & Gautherat [1998], p. 1947), 
we consider the second order autoregressive model with a real signal, for p ~ 2 
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and e = {60,61,62) = (f , -f , f ) = (0.8571, -0.2857, 0.4286). 
All quantities which appear in our estimation procedures, are adapted to the real 
case (in particular the matrix A). We characterize the results obtained in Gassiat 
et al. [1998] by AI1 and our results by M.2- The algorithm we implement here 
consists in selecting randomly a starting point for which the criteria function J„ 
takes a value close to zero, and then the pre-defined function fsolve in Matlab is 
used to find the zero. The random selection is made from points {6q,6i) which 
are uniformly distributed on the sphere Si . The signal-to-noisc ratio expressed 
in DB is denoted SNR. 








SNR 




mcthodc 


E(f)o) ± iitd(eo) 


EiBi) ± stci(8i) 


E(^0) ± std(CTo) 





1 


46 


100 


All 


0.7500 ± 0.0647 


-0.1767 ± 0.0668 


0.0000 ± 0.0000 





1 


46 


100 


M2 


0.8553 ± 0.0095 


-0.2879 ± 0.0205 


0.1004 ± 0.0100 





1 


46 


500 


All 


0.7591 ± 0.0140 


-0.1860 ± 0.0154 


0.0000 ± 0.0000 





1 


46 


500 


M-2 


0.8580 ± 0.0049 


-0.2941 ± 0.0187 


0.1035 ± 0.0031 





1 


46 


1000 


All 


0.7639 ± 0.0128 


-0.1923 ± 0.0142 


0.0000 ± 0.0000 





1 


46 


1000 


M-2 


0.8573 ± 0.0080 


-0.2837 ± 0.0151 


0.1009 ± 0.0139 


1 




0.46 


500 


Ml 


0.5913 ± 0.2537 


-0.0916 ± 0.2652 


0.9407 ± 0.1015 


1 




0.46 


500 


M2 


0.1423 ± 0.6017 


-0.4147 ± 0.2475 


0.8607 ± 0.5653 


1 




0.46 


5000 


Ml 


0.7529 ± 0.1211 


-0.2450 ± 0.1353 


1.0022 ± 0.0612 


1 




0.46 


5000 


M2 


0.5491 ± 0.5060 


-0.3259 ± 0.2020 


0.9646 ± 0.3915 


1 




0.46 


15000 


Ml 


0.7771 ± 0.1294 


-0.2576 ± 0.1206 


1.0302 ± 0.0651 


1 




0.46 


15000 


AI2 


0.7159 ± 0.3757 


-0.2928 ± 0.1476 


0.9844 ± 0.0387 



One must note that for a large SNR, the method A^2 is more pcrformant 
than the method A4 1 both in the estimated values and in the empirical standard 
deviation. The non-asymptotic side of our method is particularly highlighted in 
the case of a large SNR: when SNR is equal to 46, our method works well even 
for a small sample size and it is always better than the method Ai 1 . For a very 
small SNR (equal to 0.46), the situation is changing: no method is able to handle 
such a level of noise; to our knowledge, only the paper of Gassiat & Gautherat 
[1998] gave numerical results in this situation. One can note that, even a priori 
the results do not give satisfactory, our estimation methods works better and 
better with an increasing n . 

Another aspect which is of importance, is that our method does not need to 
calibrate some parameters, on the contrary of the estimation method in Gassiat 
& Gautherat [1998], which is based on the minimization of a penalized contrast 
function. Moreover our method does not require a starting point that we have 
to fixed in advance since, as it is mentioned above, the starting point is selected 
randomly: it is not the case for the results of the section 5 which are sensitive 
to the starting point we choose nor for the numerical results of the method 
Ail described in Gassiat & Gautherat [1998]. The method A4i needs more: the 
starting point must be near enough to the true valeur, otherwise the method 
could provide a local minimum. The gain of our method is that no a priori on 
extra parameters and on a starting point is requested, but its drawback is that 
in some cases, it generates a large standard deviation. The outlook of the future 
use of the inverse matrix since it is explicit done, would probably perform 
the numerical results. 

7. Proofs 

For convenience, denote J(cr, s(^)) = J((t, ^). We first give a very useful tool 
which is a combination of existing results obtained by Gautherat [1997] (see 
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Lemma 5.3.1 p. 130) and Gassiat & Gautherat [1999] (see Lemma 4.1. p. 1695): 
Lemma 7.1. Under assumptions (M1)-(M8) and (P), one gets 

i) V(Te]R;,V^ e/C, J„(a,0 

ii) Vn G IN, G /C, Jn{o', differentiable with respect to a and Jn(coi Co) ^ 

n — »-oo 

3iV(ao,eo)--«<0. 

iii) The function s(f) G 9i J„(cro, s(^)) is continuous on Q. 

iv) Vn € IN, Jn(o', 5) is twice differentiable in (cro,^o) wit/i respect to both a 
and ^. The first and second derivatives of J„(cr, ^) in do ci'fT'd converge 
P — a.s. to the first and second derivative of J{a,^) in ((Xoi^o)- 

v) The asymptotic distribution of(^^/nd2Jn{o'Q,£,a),V^Jn{o'o,£,o)) "is o, cen- 

tered Gaussian vector variance 

i?i/i(d((To,^o))A-i(ao||s(eo)||2)ri(A-i(ao||5(eo)||2))'(i?'Md(^o,eo)))'. 

Proof of Lemma 7.1 These resuUs are proved using the eompaetness of /C and 
in adapting the proof of Lemma 4.1 in Gassiat & Gautherat [1999] to the ahnost 
surely convergence for i)-iv), and directly from the statement adapted to the 
almost-surely convergence of Gassiat & Gautherat [1999], Lemma 4.1 for ii)-v). 
Whereas, iii) is obtained due to the truncation k{n) of s(^) and the polynomial 
structure of J„. 

Proof of Theorem 4.1. 

• Consistency of ctq- Let Vo-,, be some neighborhood of ctq ^-nd choose cti < (Tq 
in Vo-g. Due to relation (2.6), fii satisfies J(cri,^) > for all ^. On the other 
hand, due to assertion ii) of Lemma 7.1 it is always possible to consider (T2 > co 
in Vctq such that J((T2,^o) < and such that for any a G](To,cr2[, J((t, ^o) < 0. 
Assertion i) in Lemma 7.1 leads to 

n — ^oo 

>/ri(CT2,?o) ^ J{<^2,£,o)- 

n — >oc 

Let < e < inf{ J(i7i, ^o), l>^(o'2, Co)!}- Then, it exists a positive integer iVg such 
that for all n > Nq, Jn(ci, ^q) > and Jn{o'2,£,o) < 0. Thus, from ii) in Lemma 
7.1, it follows that for all ji > Nq, it exists an G]cri, (T2[ such that Jn{<Jn, Co) = 
and we choose (t„ such that an ~ inf{cr„ G]o'i,cr2[ : Jnio'n,£,o) = 0}. From 
Assertions i) and ii) in Lemma 7.1, and a Taylor expansion of J„ at {an,(,o), 
one obtains, 

Jni^n.^o) = Jn{cro,^a) + (ct„ - CTq) 9^ J„ (ctq , Co ) (1 + o(l)), 

and one gets (a-„ — ctq) 0. Since for all a < ai, Jn{a, Co) > 0, ctq satisfies 

n — >oo 

ctq > cTi. Consider only large n that is n such that n > iVo, by definition of ctq, 
one has ao < an- Since we consider only a lying in the compact set [(Ti,(T2], 
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there exists a subsequence (7o,n of ctq which converges to (Tq and which satisfies 
CTo < ctq. Since J,i(o-o,„, Co) = and due to J,i(o-o,„, Co) '—^ J{^o,^o), it 

n — >oc 

follows that J((To,Co) = 0, which contradicts the definition of (Tq (see relation 
(2.6)). This achieves the proof. 

• Consistency of Co- Consider only cr's in [CTi,cr2]. Since /C is a compact set, 
Co admits a subsequence (Cn)n which converges to Co- Assertion i) in Lemma 7.1, 
the a.s. -convergence of (Tq a-nd the continuity of J„ and s lead to J„ ((Tq i Cn ) 



-^(""OiCo)- This implies that Co is equal to Co since J(cro,Co) = <=> •s(Co) = ^■ 
Suppose now there exists Co accumulation point which is different from Co- 
Then it exists another subsequence C„ of Co which converges to Co- Using the 
same tricks as previously, one gets s(Co) = ^ which proves the uniqueness of Co- 

Proof of Corollary 4.1. This proof is explicitly done in Gautherat [2002] (see 
proof of Theorem 3.2). It is only based on the consistency of cto and Co- 
Proof of Theorem 4.2. The definition of ctq leads to Jn{^o,£,o) = 0. It entails 
that both dlJj^{ao,£_Q) — and J,^((To7 Co) = 0^. For simplicity's sake, denote 

^n(<70,Co) = Jn, l9[' J„(cro,Co) = l9[' J„, i = 1, 2 and dl'f' Jn{(To,^o) = dl'f'Jn, 

i,j = 1,2. Therefore, one can apply the Delta method to J,^ at (cro,Co), since 

/ aij2(ao,Co) \ / 2J„(ao,Co)52V„(ao,Co) \ ^ ( 
\ aij2(ao,Co) ; 1^ 2J„(ao,Co)5iV„(ao,Co) / V « 

Now, the expansion at the first order of at (cro,Co) is 

2[d\Jn)' d\Jn + 2Jnd2Jn 2 (92 Jri)'9l J„ + 2 J„9j^ J„ \ / p ^ \ 

( 1":^" )(i+o(i)) 

2dlJndlJn + 2J,,{dlpr^)' 2(^1 J„)2 + 2J„i?l J„ / ^ ^ 

2JndlJn \ J Od 
2Jnd\Jn ) \ ^ 

Denote A„ = (5| J„)'9;^J„ + J„9|J„, B„ = {dlJn)'d\Jn + Jndl'^Jn and = 
(dlJn)^ + JndfJn- Then, from the Schur complement (Searle [1982]), we obtain 



( i"'^' )(i+o(i)) 

V f^o - o-o / 



V d^-BtA-^l,. l-B'nA~HdUnY + d^n) ) ' 

For n fixed, note that Jn(CTo,Co) differs from zero. Thus, one could rewrite the 
up-right term in the previous equation using the expression of _B„ and dividing 
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it by Jn] it gives three terms Ti, T2 and T3 which are defined by: 

I ■ 



Jn J dn ~ B'j^An Bn 

Rewrite the approximation of the vector (^0 ^ Co^^o ~ '^0)' ^-s follows 
^ f T1+T2+T3 \ 



IP — a s 

Due to Lemma 7.1 and the contimiity of Jn in ^, one has — '> 0, 

n — >oo 

n — ^oo ^ n — >oo 

— — - — ^ W, where W is a d-dimensional non degenerate random vector and 
±oo. As n large enough, it entails that 



Bn 

n — >oo 

^ n 



\ o-Q - o-a J — 



(7.1) 



V 



Note that h{d{aQ, ^q)) = Jnio'OT £,o)i where h is the determinant function. Then, 
due to Assumption (M7) and due to the Taylor expansion of h at d{ao,^o), one 
obtains 

h{d{<Jo,^o)) = D^h{d{<Jo,^a))A-\<Jo\\e\\2){dn{^o) - d{^o) + o{^)){7.2) 

Vn 

Set M = A-\ao\\s{^o)h)ri{A-^{ao\\s{^o)h)Y and 

N = \ \, then due to (7.1), (7.2) and v) of 

V ^ J 

Lemma 7.1 one gets, 





-Co ^ 








n—>-oo \ 



Proof of Corollary 4.2. Following the proof of Theorem 3.3 in Gautherat 
[2002], it remains to obtain an equivalent for v^(^n(<''0) ^o) — d{ao,^o)). As n 
large enough, this term is equivalent in distribution to 

(ld^p+,y + D'diao,^o)D'h{diao,^o))N) A~\ao,\m2)V^^{dn{^o) - d{^o)). 
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On the other hand, one has 

yH(a-a) = (^^^S^ V"(rf«(o-o,Co) - rf(cro,Co)), (7.3) 
V^(n - n) - (^Proj + F^-^B^ V^(rf„(ao,fo) - (i>o, ^o)).(7.4) 

Relations (7.3) and (7.4) entail the results. All matrices used here are defined 
in the statement of both Theorem 4.2 or Corollary 4.2. 
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